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Assistant Commissioner for Patents 
Washington, DC 20231 

Inventor(s): Nandakumar Sampath, Enrique M usoll. Stephen Melvin and Mario Nemirovsky 
Title of Invention: Mechanism To Un-Speculativqly Pre-Fetch Instrucrions From The Thread Associated To A Packet 



_sheets of description and 
10 . 00 is enclosed to 



Enclosed is a disclosure of the above-titled invention consisting of 5_ 

Q. sheets of drawings. A cJieck or money order in the amount of . 

cover the fee (37 CFR 1.21(c)). 

The undersigned, being a named Inventor of the disclosed invention, requests that the enclosed papers be 
accepted under the Disclosure Document Program, and that they be preserved for a period of two years. 
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invention and a patent application should be diligently filed if patent protection fs desin 
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If you are not familiar with what Is considered to be "diligence in completing the Invention" or "reduction to practice" under the patent 
law or if you have other questions about patent matters, you are advised to consult with an attorney or agent register^ to pfBctlce 
before the USPTO. The publication, AttomQys and Agents Regr/sfered to Practice Before the United States P^nt and Trademark 
Offfce, is available from the Suporintendont of Documents, Washington, DC 20402. Patent attorneys and agents are also listed in 
the telephone directory of most major cities. Also, many large dtias have asaodations of patent attorneys which may be consulted. 

You are also reminded that any public use or sale In the United Statss or publication of your invention anywhere \n the world 
more than one year prior to the filing of a patent application on that invention will prohibit the granting of a patent on it 

Disclosures of inventions which have been understood and witnessed by persons and/or MlaijEed are other examples of evidence 
which may also be used to establish priority. ff*^ 

There is a nationwide network of Patent and Trademark Depository Libraries (PTDLs), wfcit^h^ colldc^n»Sf,fta{ents and patent- 
related reference materials available to the public, including automated access to USFTO^ataM^j^pyn^^hd^^^ Genemi 
Informstion Concerning Patents are available at the PTDLs, as well as the USPTO's Web site arww^^i^^ out the 

location of the PTDL closest to you, please consult the complete listing of all PTDLs that appears on the C^PTO's \Nht site or In every 
issue of the Official Gazette, or call the USPTO's General Infomnation Services at 800-PTO-9199 (800-799-91 &9f6r 703-308-HELP 
(703-308-4357), To Insure assistance from a PTDL staff member, you may wish to contact a PTDL prior to visiting to leam about its 
collections, services, and hours.' . 
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CCPA Patent Disclosure Form 



This form is provided by CCPA in an effort to obtain enabling written disclosure 
for the purpose of preparing patent cases on behalf of our clients. 

Please take the time to fill it out properly as the provision of clear and concise 
disclosure will speed the process of preparing and filing your case. In addition a signed 
disclosure document filed with the patent office can effectively remove references 
anticipating our invention in the prosecution of the case thereby enhancing our chances of 
obtaining patents. In most cases, verbal disclosure or short e-mail messages are 
inadequate forms of disclosure and should be avoided. 

To fill out the form correctly, follow each set of instructions provided with each 
heading. 

Title of Invention 

This section is simply a brief descriptive title of the invention. 

Insert title here Mechanism to un-sveculativelv vre-fetch instructions from the thread 
associated to a packet 

Inventors 

We will need the residence address, mailing address, full legal names and citizenship of 
each inventor at the time of submission of the disclosure. 



Nandakumar Sampath 



Enrique Miisoll 
Stephen Melvin 
Mario Nemirovsky 



Related inventions known or authored by vou or your company 

This section should list any prior patents known to you or patents that you have 
already filed if the present invention depends on them for successful practice, 

[1] PA3818 



Background 

This section is used to describe "the state of the art" before being improved or 
enhanced with your invention. It should include a brief summarization of existing 
technologies if any that the present invention improves upon or replaces, a description of 
any specific problems with "the way the art is practiced now", and a very brief statement 
of what is needed to improve or replace the existing art. Include references by U.S. patent 
number any closely related patents discovered during any prior-art searches 

Begin Background here; 



The PMU unit within XCaliber receives the newly arrived packets and activates an 
available (i.e. not used by the SPU) context after pre-loading some of the registers of the 
context with useful information about the packet 

Upon the activation of the context, the SPU can start fetching and executing the 
instructions of the corresponding thread. 

An improvement in performance is achieved if the SPU is notified as soon as the PMU 
selects a context for activation and before the pre-loading of the registers starts. 
Therefore, the SPU can prefetch the instructions of the corresponding thread. These 
instructions will not start to be executed until the context is activated by the PMU 
This mechanism of notification to the SPU that a pre-load of a packet starts has been 
briefly mentioned in the description of patent disclosure [1], but not covered with any 
claim. 



Description of Invention 

This section should explain the basic apparatus and method of practicing your 
invention according to a preferred state. If certain apparatus of the invention is not 
known in the prior art then indicate so. If a method of the present invention is not known 
in prior art then indicate so. If certain methods and apparatus are known in prior art then 
they do not have to be greatly detailed. However any new subject matter novel over the 
prior art should be fully explained and represented by drawings and/or sketches. 



Begin description here: 



• 



One function of the PMU unit within XCaliber is to activate an available (i.e. not used by 
the SPU) context after pre-loading some of the registers of the context with useful 
information about the packet to be processed. 

The unit within the PMU that performs this task is called Register Transfer Unit or RTU, 
and it performs the activation in three different steps: 

J . Notifies the SPU that a context has been selected for activation, and that the pre- 
loading of that context is going to start. 

2, Stores in some of the registers of the selected context information regarding the 
packet (an identifier of the packet, the address where the packet resides in the 
packet memory and, possibly, some bytes of the header and/or the payload). 

3. Notifies the SPU that the context is ready for processing, i.e. the context is 
activated 

In both steps I and 2 the RTU provides to the SPU the number of the context selected and 
the PC address where the stream that will run on the context will start fetching 
instructions from. This PC address is programmable in the RTU, and it can be different 
depending on the queue within the queuing system block of the PMU the packet is 
activated from. This is how it has been implemented in XCaliber. Another option would 
be that the PMU does not provide any PC address and the SPU always starts fetching 
from a fixed PC address regardless the queue number. 

Step 2 may take several cycles, especially if bytes of the header and/or payload of the 
packet are pre-loaded in some of the registers of the context. 

Step 1 is not required for the correct hehmnor of packet activation, however it provides a 
performance improvement since the SPU can use its idle resources to start fetching the 
instructions that will eventually be executed. Note that these instructions are un- 
speculatively fetched since when the RTU starts the activation of a context, it will 
eventually finish it, meaning that a new sti^eam will be created in the SPU 



Thus, as soon as step 3 occurs, the SPU might have already fetched the instructions and 
is ready to execute them with no delay. In a design without step I the SPU would need to 
wait to start executing instructions until the instructions have been fetched (which might 
take a long time if the instructions do not reside in the instruction cache). 

What is disclosed here is step 7, which is non-obvious and it provides improved 
performance on the SPU by hiding the latency of fetching the initial instructions for an 
stream. 



Please have all inventors sign the disclosure and mail a hard copy to CCPA for 
participation in the document disclosure program. Also e-mail to Mark Boys 
niarkboys@centralcoastpatent.coni and CC Don Boys rexboys@centralcoastpatent.com 
Your cooperation in the filling and return of this form will expedite the processing of your 
application and increase our chances of obtaining a patent for your invention. 
Mark Boys, CCPA 



